Comparison of the Evaluations of a Case-Based Reasoning Decision Support Tool by Specialist Expert Reviewers with Those of End Users
نویسندگان
چکیده
BACKGROUND Decision-support tools (DST) are typically developed by computer engineers for use by clinicians. Prototype testing DSTs may be performed relatively easily by one or two clinical experts. The costly alternative is to test each prototype on a larger number of diverse clinicians, based on the untested assumption that these evaluations would more accurately reflect those of actual end users. HYPOTHESIS We hypothesized substantial or better agreement (as defined by a kappa statistic greater than 0.6) between the evaluations of a case based reasoning (CBR) DST predicting ED admission for bronchiolitis performed by the clinically diverse end users, to those of two clinical experts who evaluated the same DST output. METHODS Three outputs from a previously described DST were evaluated by the emergency physicians (EP) who originally saw the patients and by two pediatric EPs with an interest in bronchiolitis. The DST outputs were as follows: predicted disposition, an example of another previously seen patient to explain the prediction, and explanatory dialog. Each was rated using the scale Definitely Not, No, Maybe, Yes, and Absolutely. This was converted to a Likert scale for analysis. Agreement was measured using the kappa statistic. RESULTS Agreement with the DST predicted disposition was moderate between end users and the expert reviewers, but was only fair or poor for value of the explanatory case and dialog. CONCLUSION Agreement between expert evaluators and end users on the value of a CBR DST predicted dispositions was moderate. For the more subjective explicative components, agreement was fair, poor, or worse.
منابع مشابه
Comparison of the Evaluations of a Case-Based Reasoning Decision Support Tool by Expert Reviewers with those of End Users
متن کامل
Development of decision support tool for municipal solid waste management system in Iran based on life cycle assessment approach
Background and Objective: Various aspects including the environmental burdens, social and economic consequences of the waste management(WM) scenarios must be considered to come up with a comprehensive WM plan. Life Cycle Assessment (LCA) approach is a systematic method to quantify the environmental burdens of each WM scenario. Materials and Methods: This study used an LCA approach to develop a...
متن کاملMulti-perspective Decision Support System for Hierarchical Bus Transportation Network Design: Tehran Case Study
In this paper, a multi-perspective decision support system (MP-DSS) to design hierarchical public transportation network is developed. Since this problem depends on different perspectives, MP-DSS consists of two sub-systems with macro and micro sub-systems based on travel information, land use and expert knowledge. In the micro sub-system, two sub-modules are developed considering o...
متن کاملAn application of principal component analysis and logistic regression to facilitate production scheduling decision support system: an automotive industry case
Production planning and control (PPC) systems have to deal with rising complexity and dynamics. The complexity of planning tasks is due to some existing multiple variables and dynamic factors derived from uncertainties surrounding the PPC. Although literatures on exact scheduling algorithms, simulation approaches, and heuristic methods are extensive in production planning, they seem to be ineff...
متن کاملCase study: Redesigning a Kansei Engineering Designed Scissors by User Centered Design Approach
This paper is based on the research which was conducted earlier on Kansei Engineering (KE) and resulted in a new concept for scissors to redesign it with another method called “User Centered Design” (UCD). This is a shift from translation of the consumers’ psychological feeling about a product related to their perception of the design (KE) to focus on designing for and involving users in the de...
متن کامل